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(54) Data management system and method for replicated data 



(57) The present invention provides a data manage- 
ment system and method for managing copies of a 
shared data file maintained on a plurality of computer 
systems that are connectable via a mobile communica- 
tions network. The system comprises: logging means 
410, associated with each copy 420 of the shared data 
file, for keeping a record 540 of modifications made to 
that copy; retrieval means for retrieving, via connection 
to the mobile communications network 460, the records* 
550 maintained for other copies 420 of the shared data 
file; merging means 560 for merging the retrieved 
records to generate a sequence of modifications; con* 
flict resolving means 590 for applying predefined rules 



580 to the sequence of modifications to resolve conflicts 
within the sequence of modifications; and means 590. 
for modifying the copies 420 of the shared file based on 
the conflict-resolved sequence of modifications. 

The present invention provides a generic platform 
which allows conventional applications to make efficient 
use of mobile data connections. The solution is generic 
in that it is not restricted to one application or to a par- 
ticular set of applications. Further, it improves efficiency 
since it retains communication autonomy from the ap- 
plications and handles the data in an efficient manner. 
Further it is easy to use since applications need not be 
modified to make use of the facilities provided. 
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Description 

Field of the invention 

The present invention relates to a system and meth- 5 
od for managing replicated data, and in particular to a 
system and method for managing copies of a shared 
data file maintained on a plurality of computer systems 
connectable via a mobile communications network. 

w 

Background of the Invention 

Computing technology now penetrates all aspects 
of life, with national and international communications 
networks providing rapid exchange of information. How- is 
. — - ever.xurrenrnetworks'aTe typically^tjll restricted by be- 
ing location -fixed. While access to international net- 
works, especially the world-spanning 'Internet', is in- 
creasingly important, it is restricted to the relatively 
sparse access points of wired networks. 20 

The advent of mobile communication systems in the 
1 980s has shown that this restriction can be alleviated 
by the provision of a system of transmitters arranged in 
a cellular layout to cover large geographical areas, 
these transmitters using a small set of frequencies and 2s 
therefore take up comparatively little bandwidth. Within 
this geographical coverage area communication links 
can be set up easily with readily-available equipment. 
Although this infrastructure was initially developed for 
voice traffic ('mobile telephone'), it has been expanded 30 
quickly to allow for data traffic as well. 

Today, data connections can be established on 
most voice-grade mobile communications systems and 
several data-only networks which are in operation in var- 
ious countries. An example- is the recently introduced 3S 
'Global System of Mobile Telephone' or GSM for short, 
which provides not only pan -European coverage today, 
and possibly global coverage in the short- to medium- 
term future, but also high-quality voice traffic and data 
connectivity. 40 

The business community has already accepted 
GSM for its international coverage/Since data connec- 
tivity can be provided through the same hardware at no 
additional network-cost it is widely anticipated that the 
benefits of mobile data, lor example e-mail, will be well *5 
received by this particular user-community given the 
right packaging. Hardware and software developers are 
currently endeavouring to provide services and applica- 
tions to suit the users' needs. 

There are, however, a few problems which need ad- so 
dressing. Due to the nature of data transmission over 
air much error correction is required, and thus band- 
width is limited; currently, 9600 bits per second can -be 
achieved at maximum. At the same time, mobile data 
connections on networks such as GSM are billed in the 55 
same way as mobile voice connections are, i.e. they are * 
based on connection time rather that the amount of data 
actually transmitted. Given the premium -priced connec- 
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lion charges typical for the mobile tetephbne industry 
and this low speed, the transmission of one megabyte 
of data currently costs around $10 worth of connection 
time. The slightly cheaper but also slower packet -orient- 
ed data-only networks, on the other hand, suffer from 
high network turnaround times (in the UK, turnaround- 
times in excess of 20 seconds are not unusual). Since 
mobile links are expensive and, for the most popular net- 
works, charged based on connection time, applications 
which make inefficient use of data links are liable to 
waste money. The user wants to use mobile links effec- 
tively and wants to be able to control usage of expensive 
links. 

An additional problem is that of ease of use. A 
number of applications axe.already. availab le which , to - 
some extent, manage mobile connections efficiently by 
applying advanced compression methods. Unfortunate- 
ly, those applications often force the user into particular 
interaction patterns which are frequently not only new 
but also peculiar. In all cases they will give a different 
'look and feel' than conventional applications. Computer 
practitioners are often used to a small set of applica- 
tions, and are reluctant to adopt a new interface, espe- 
cially when it does not replace the old design but is sup- 
posed to be used alongside of it. 

Furthermore, it is still a non-trivial task to set up all 
communication components correctly and start up a mo- 
bile connection. Ideally, mobile applications should be 
similar if not identical to conventional ones, and the use 
of a mobile link should be as transparent as possible to 
the user. 

Since the network internals have to be accepted as 
given and are beyond the influence of application devel- 
opers, solutions to the various challenges and problems 
inherent in the use of mobile connections have, in the 
past, concentrated on two areas, either the application 
itself, or the underlying communications protocol. We 
will consider both of these approaches below. 

Improving Individual Applications: 

Numerous applications have been adapted over the 
past few years to run over mobile links. Programs like 
mail- and news-readers or WWW-browser are particu- 
larly popular, but a vast number of custom-built mobile 
applications (which are therefore little known to the gen- 
eral public) are also in use. Fine-tuning applications has 
the advantage that they can be customised not only for 
a mobile link in general, but for one specific mobile net- 
work in particular. Hence, they can make full use of the 
network-specific transmission characteristics and band- 
width, thus providing the best possible data-handling. 
On the other hand, this fine-tuning is Jikely to involve 
many modifications to low-level application code, which 
may lead to incompatibility with the original application 
and seriously hampers the portability of the application 
to other platforms and networks. It also leads to a seri- 
ous lack of separation between the application-specific 
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and communication-related aspects of the application. 
Much of the effort has to be repeated for each applica- 
tion. 

Improvement of the Communication Protocol: 5 

The alternative approach of attempting to improve 
the underlying communication protocol has the obvious 
advantage that it is application-independent and there- 
fore avoids many of the pitfalls of the above approach. io 
Fine-tuning existing protocols such as TCP/IP for mobile 
links (for example by applying VJ-header compression 
as discussed by V Jacobson in his article 'Compressing 
TCP/IP headers for low-speed serial links', 'Request for 
- .. ^QrpnijnJl.(BEQ) t -l s 1^,^eb. T 1:990 i or usingaugmented— 1& 
versions of TCP/tP suchas 'Mobile IP' or 'Indirect TCP'), 
or making these standard protocols available on other- 
wise non-compliant networks (as for example does 
IBM's ARTour system) has the obvious advantage that 
a large number of applications can benefit from the ef- 20 
fort. It also provides a clear cut separation between the 
communication aspects and the application itself. Un- 
fortunately, these communication piatforms handle data 
genericaliy and thus can not make -use of application- 
specific reduction and compression methods. Hence, 25 
they serve to make applications portable and offer an 
optimised data-transmission subsystem but, on their 
own, can do little to improve the application's perform- 
ance. 

Obviously, both approaches can be applied to give 00 
best results by combining the strengths of both - efficient 
data handling and efficient data transmission. In partic- 
ular, this is useful for heavy-duty applications such as 
video or. image transmission, but is not advisable in the 
genera! case since it also combines the pitfalls of both 35 
approaches. 

Both approaches increase efficiency of the trans- 
mission sub-system on different levels. However, they 
have little to offer with regard to the two problems of 
'budgetabilily' and 'ease of use* discussed earlier. Whilst 40 
systems have been developed which allow conventional 
network applications to run over mobile links by provid- 
ing a standard programming environment on top of the 
often proprietary protocols within the mobile network, 
this approach has proven to be difficult in practice since *5 
conventional applications have been built on top of high- 
speed links and are, in general, too bandwidth-hungry 
to function over mobile links, or are simply too expensive 
to run. Neither approach can efficiently support interac- 
tive applications, where actual data transmission only so 
represents a small fraction (often less than 1%) of the 
total running time of the application.. This, of course, is 
a particularly severe limitation if used in conjunction with 
circu it-switched networks, where call charges are based 
on connection time (such as the GSM network). While ss 
a GSM connection can be disconnected if no traffic is 
encountered for some time, it has been found that re: 
establishing a modem-connection over current GSM- 



networks takes on average 28 seconds which makes 
this difficult to handle. 

The object of the present invention is to provide an 
improved system and method for managing data repli- 
cated across a plurality of computers which communi- 
cate over a mobile communications network. 

Summary of the Invention 

Accordingly the present invention provides a meth- 
od of managing copies of a shared data file maintained 
on a plurality of computer systems that are connectable 
via a mobile communications network, the method com- 
prising: (a) for each copy of the_shared data file, main-, 
-taining a^recbrcJ -of "modifications made to that - copy; (b) 
retrieving, via connection to the mobile communications 
network, the records maintained for other copies of the 
shared data file; (c) merging the retrieved records to 
generate a sequence of modifications; (d) applying pre- 
defined rules to the sequence of modifications to resolve 
conflicts within the sequence of modifications; and (e) 
modifying the copies of the shared file based on the con- 
flict-resolved sequence of modifications. 

The above invention alleviates the problems men- 
tioned earlier by providing a generic platform which al- 
lows conventional applications to make efficient use of 
mobile data connections. It is generic in that it is not re- 
stricted to one application or to a particular set of appli- 
cations. Further, it improves efficiency since it retains 
communication autonomy from the applications and is 
arranged to handle the data in an efficient manner. Fur- 
ther it is easy to use since applications need not be mod- 
ified to make use of the facilities provided. 

It should be noted that the reference to a 'shared' 
data file does not necessarily mean that there need be 
multiple users. The invention is equally applicable to sit- 
uations where a single user 'shares' the file across dif- 
ferent machines, for example the computer in his office 
and a portable computer taken by the user when work- 
ing away from the office. 

In preferred embodiments, said record maintaining 
step (a) is performed on each of the plurality of computer 
systems, and the. plurality of computer systems are dis- 
connected from the mobile communications network 
during step (a). Further, the plurality of computer sys- 
tems are preferably only connected to the mobile com- 
munications network during said retrieval step (b). 

In preferred embodiments, each of said steps (a) to 
(d) are performed on a number of said plurality of com- 
puter systems, said step (b) comprising the exchange, 
via connection to the mobile communications network, 
of the records maintained by said number of the plurality 
of computer systems, and said step (e) comprising the 
modification of the local copy of the shared file. By such 
an approach, only one connection to the mobile com- 
munications network is required in order to enable the 
local copy of a shared data file to be updated. 

To assist in the automatic resolution of conflicts be- 
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I ween modifications, in preferred embodiments priority 
information is stored with each modification as it is re- 
corded during said record maintaining step (a), and at 
said merging step (c) the priority information is used to 
assign relative priorities to any- conflicting modifications 
for subsequent resolution at said conflict resolving step 
(d). Preferably, the priority information stored at said 
, record maintaining step (a) comprises the identity of the 
user who makes the modification. Further, in preferred 
embodiments, the priority information also includes time 
stamp information, such that an earlier modification has 
a higher priority than a later modification. However, any 
other suitable priority information can be stored to ena- 
. ble priorities to be assigned to conflicting modifications. 
..... ^Given.somelorm : of T p.riprjtis 

described above, then in preferred embodiments, a con- 
flicting lower priority modification is completely invalidat- 
ed during the conflict resolving step (d). By employing 
this approach, the preservation of file format is guaran- 
teed, but information will be lost. Alternatively, a different 
approach can be used where only the conflicting part of 
a lower priority modification is invalidated. This has the 
advantage of only removing the minimum amount of in- 
formation necessary to derive a non -conflicting set of 
modifications, but rhay not preserve the file format. It will 
be apparent that other policies could be used to define 
how conflicts are resolved at said step (d). 

For the purposes of improving the efficiency of data 
transfer over the mobile communications "network, the 
. records are preferably compressed prior to being sent 
over the mobile communications network during the re- 
trieval step (b). 

Viewed from a second aspect the present invention 
provides a computer system for maintaining a copy of a 
shared data file, copies of the shared data file also being 
maintained on a plurality of other computer systems that 
are connectable to the computer system via a mobile 
communications network, each computer system being . 
arranged to keep a record of modifications made to its 
copy of the shared file whilst disconnected from the mo- 
bile communications network, the system comprising: 
retrieval means for connecting the computer system to 
the mobile communications network to retrieve the 
records kept for copies of the shared data file main- 
tained on the plurality of other computer systems; merg- 
ing means for merging the retrieved records with the 
record kept for the local copy of the shared data file to 
generate a sequence of modifications; conflict resolving 
means for applying predefined rules to the sequence of 
modifications to resolve conflicts within the sequence of 
modifications; and means for modifying the local copy 
of the shared file based on the conflict-resolved se- 
quence of modifications. 

Viewed from a third aspect, the present invention 
provides a data management system for managing cop- 
ies of a shared data file maintained on a plurality of com- 
puter, systems that are connectable via a mobile com- 
munications network, the system comprising: logging 



means, associated with each copy of the shared data 
file, for keeping a record of modifications made to that 
copy; retrieval means for retrieving, via connection to 
the mobile communications network, the records main- 

s tained tor other copies of the shared data file; merging 
means for merging the retrieved records to generate a 
sequence of modifications; conflict resolving means for 
applying predefined rules to the sequence of modifica- 
tions to resolve conflicts within the sequence of modifi- 

'0 cations; and means for modifying the copies of the 
shared file based on the conflict -resolved sequence of 
modifications. 

Brief Description of the Drawings 

The present invention will be described further, by 
way of example only, with reference to a preferred em- 
bodiment thereof as illustrated in the accompanying 
drawings, in which: 
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Figure i illustrates the different software compo- 
nents within a data communication system; 
Figure 2 illustrates the data management system of 
the preferred embodiment of the present invention; 
Figure 3 illustrates the different modes of operation 
of the Mobile Application Framework of the pre- 
ferred embodiment of the present invention; 
Figure 4 is a diagram showing the components of 
the Mobile Application Framework of the preferred 
embodiment of the present invention; 
Figure 5 is a diagram illustrating how the various 
components of the model are used in the preferred 
embodiment of the present invention; and 
Figure 6 is a diagram showing a screen view of a 
'framework-aware' application that may be used in 
association with preferred embodiments of the 
present invention. 

Description of the Preferred Embodiment 



Figure 1 provides a rudimentary classification of the 
different software components within a data communi- 
cation system. The application 100 is divided into its us- 
er interface ('UP) 105 and the application's engine 110. 

*5 On the operating-system level 1 1 5, a very crude distinc- 
tion is made between the storage system 120 and the 
operating system's drivers 1 25 for external components. 
The network 130 sits underneath and is driven by the 
operating system 115. The middle column of figure 1 

so classifies the data associated with the different compo- 
nents, together with, on the right, an indication of the 
size of the data -handled by each component and its 
typeability, that is, the detail to which type information 
can be inferred by looking at the data unit. 

55 Whilst data at the application level is handled in 
large chunks which can easily be typed, size as well as 
typeability steadily decrease at the lower levels. Finally, 
at the protocol level ('Drivers') dala is handled in small 
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chunks ('Packets') where it is difficult to infer type infor- 
mation. 

Ideally, mobile communication would be handled on 
a layer low enough to allow a large number of applica- 
tions to benefit and high enough to give insight into the 
type of data being transmitted to allow the use of spe- 
cialised compression and reduction methods. Accord- 
ing to the preferred embodiments of the present invent 
lion, mobile communication is handled at the file-system 
level, since most application programs use files for data 
input and output, so a broad spectrum of applications 
can benefit. Files also comprise data-units rather than 
pieces of data, and thus, the file-type can often be in- 
^ -f ^erred. s EurtherrTX)r.e^it e has = been,realisedahat i continu^ 
ous connection is not required during normal operation, 
since all applications can operate on data available lo- 
cally/ thus allowing reasonable support for interactive 
applications; connections are only required occasionally 
to re-synchronise the files. 

In the area of wired (terrestrial 1 ) communications 
networks, as opposed to mobile communications net- 
works, some distributed filing-systems have been de- 
veloped. Network file systems such as Sun Microsys- 
tems Inc's Network File System (NFS), or the Andrew 
.. File System (AFS) from Transarc Corp, are used on 
wired networks to gain access to data files held at re- 
mote nodes. Thus, local applications can work on data 
held at remote sites and files can be shared between 
many users. Effectively, the use of a network is entirely 
hidden from the user, who sees all files as local. In the 
simplest form, these systems operate by redirecting 
read/write operations across the network using some 
sort of remote procedure call facility. Caching is often 
used to reduce traffic load on the network. 

When simultaneous editing is allowed, convention- 
al file systems make use of various locking methods to 
ensure data consistency. Voting has been proposed in- 
stead of locking, but wr'rte-access is still restricted to one 
site which has to obtain write-permission for sufficiently 
many copies prior to accessing a file. Many systems use 
tokens to coordinate access to replicated files, but the 
passing of tokens again requires communication links 
to be operational between the sites. In the article "Con- 
sistency and recovery control for replicated files', Pro- 
ceedings of the 10th ACM Symposium on Operating 
Systems Principles, December 1985, Davcevand Bur- 
khard have proposed a system which allows, write-ac- 
cess when the network is partly disconnected, but only 
within the so-called 'majority-partition'. In the article "An 
overview of reliability mechanisms for a distributed data 
base system', Proceedings of the spring COMPCON, 
February 1978. Hammer and Shipman have proposed 
a technique which does not require locks for write-oper- 
ations and therefore allow files to diverge slightly but re- 
lies on the communication links to resolve the resulting 
inconsistencies within tight time constraints. 

Lotus Notes allows multiple read/write replicas of 
its special database. Replicas are periodically recon- 



ciled, usually no more than once or twice a day. Detec- 
tion of a conflict between replicas causes the creation 
of separate versions with no attempt to automatically re- 
solve the conflicts, this resulting in significant manual 
5 burden whenever a conflict occurs. A different approach 
is discussed in European Patent Application EP-A- 
0,684,558, which describes a replication system in 
which a plurality of servers maintain updatable replicas 
of a file. An update propagation protocol is used, which 
io is described as 'aggressive - in that it causes a replica 
update as soon as possible after a failure leading to in- 
consistent data has been identified. In effect, the servers 
coordinate amongst themselves to detect replica incon- 
^-^.sistenciesand^initiate.an,^ 

'5 or conflicting replicas without waiting for a client request 
for data. Although some conflicts are resolved automat- 
ically, manual intervention may be required to repair 
conflicting files. 

More recently, Microsoft Corporation has released 
20 a 'Briefcase Folder* facility as part of its Windows-95 
product. This facility provides conflict resolution facilities 
for applications that are written on top of the briefcase 
facility, and hence is only applicable to that subset of 
applications. Further, it does not initiate reconciliations 
& automatically and requires significant manual guidance. 
The above file system level techniques are not suit- 
able for a mobile environment due to their reliance on 
fast, continuously available communication links and/or 
their liberal use of locking methods which seriously ham- 
50 pers prolonged periods of disconnected operation. 

Figure 2 illustrates the set-up of.the data manage- 
ment system of the preferred embodiment, which will be 
referred to hereafter as the 'Mobile Application Frame- 
work* 200. In the Figure 2 example, both users 210, 220 
3$ operate locally with local copies of the shared file (rep- 
resented by the disk-symbol 205), white the framework 
200 underneath endeavours to keep both copies syn- 
chronised. It is important to note that with this framework 
it is no longer the applications that communicate or ini- 
<o tiate transmissions, but the underlying framework. 

Some file systems, notably 'CODA 1 (see the article 
"Disconnected Operation in the Coda File System*, 
ACM Transactions on Computer Systems, 10(1), Feb- 
ruary 1992, by J Kistler and M Satyanarayanan), are 
4$ now being extended to allow disconnected operation for 
periods of networks being down and thus make a step 
in this direction. Additionally, the article 'Combining Lo- 
cation and Data Management in an Environment for To- 
tal Mobility" by Monica Wachowicz and Stefan Hild, Pro- 
50 ceedings of the International Workshop on Information 
Visualization and Mobile Computing, Rostock. Germa- 
ny, February 1 996. describes a total mobility' architec- 
ture, in which a user no longer carries his portable com- 
puter with him/her but instead will register with a rented 
ss computer at his/her destination. As part of this architec- 
ture, a disconnected operation is contemplated, in which 
data is manipulated in disconnected mode by applica- 
tions running on the mobile host. Changes to the data 
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file are stored to facilitate later reconciliation with other 
copies of that file. A first outline of the data management 
subsystem forming part of the total mobility architecture 
was presented by Stefan Hild in the position statement 
•Disconnected Operation for Wireless Nodes 1 ', pub- s 
lished in the Proceedings of the ECOOP '95 Workshop 
on Mobility arid Replication, European Conference on 
Object Oriented Programming, August 1 995. This paper 
briefly describes the general concept of disconnected 
file access and reconciliation within a mobile environ- w 
ment. 

The 'Mobile Application Framework' takes the view 
that disconnected operation (i.e. noconnection is estab- 
lished with the stationary host) is the norm and that con- 
^;^nected.p.eric<js.are-the,exceptions,.ratherthan : vice:ver;^ *s- 
sa. Consequently, the 'Mobile Application Framework' 
of the preferred embodiment differs in many ways from 

• conventional network file system and those allowing dis- 
connected operation, as will become more apparent 
from the more detailed description which follows. 20 

In preferred embodiments, the 'Framework' is used 
as a tool for sharing a small number of files of primary 
importance between a small number of users. Setting 
up such -a 'work-group' is a simple but conscious proc- 
ess. By taking this careful approach to the concept of 2$ 
'sharing', the 'Framework' can afford to take a much los- 
er stance on file consistency Hence, the 'Framework' is 
neither a replacement nor an extension to conventional 
network file systems but facilitates the management of 
replicated files. Some of its main features will now be oo 
discussed in more detail. 

As outlined above, the Framework relies heavily on 
disconnected operation. The state-diagram in Figure 3 
indicates the different modes of operation and also out- 

• lines the state of connectivity with the rest of the net- 35 
work. 

During normal (disconnected) operation, the 
Framework is in 'Log'-mode (slep 300). During this pe- 
riod, all modifications executed on the shared files are 
recorded and stored in logs. No restrictions are in place <o 
regarding the access to shared files: both read- and 
write-operations are supported on all nodes sharing the 
same file simultaneously 

On reconnection. the Framework re-establishes 
connection to some number (not necessarily all) of the *s 
other sites holding copies of the shared file and ex- 
changes, at step 310, the recorded logs with those sites. 
This is the only step requiring network connectivity ('Ex- 
change'). 

The three remaining states serve to re -synchronise so 
the shared file. Initially, the logs received from the other 
sites and the local log are merged at step 320 into a 
unique sequence of modifications ('Merge'), then con- 
flicts are resolved ('Resolve') at step 330. and finally the 
files are brought into line with the merged and resolved ss 
log at step 340 ('Rerun'). 

Figure 4 illustrates the internal components of the 
Framework and also gives some justification for its 



name. Rather than.providing a platform for a mobile ap- 
plication to run on, it also consists of components which 
run on the same level as the application (especially the 
logger 410) and thus provides a framework* for the ap- 
plication to run in. In detail, the different components are 
the logger 410, which logs all modifications executed on 
the local copy of the shared data file, the file being rep- 
resented by the disk 420 in the figure. The logger 410 
has available a number of models 430 which are formal 
descriptions of contents-type and possible edit-opera- 
tions for various file-types to assist the detection of mod- 
rfications. Defaults are available which have been de- 
signed to work with any file-type. These models will be 
discussed in more detail later. 

--- The:controlle^440-comprises^most-of the logic and- 
is responsible for initiating reconciliations (i.e. sending 
the reconnection event) and for guiding the reconcilia- 
tion process. Finally, the communication module 450 
handles the actual interfacing with the underlying mobile 
communications network 460. 

In preferred embodiments, each of the above men- 
tioned elements of the Mobile Application Framework 
are contained on each computer system 400 that is 
maintaining a copy 420 of the shared data file. Each time 
the controller 440 on a particular computer system 400 
determines that the copy of the shared data file should 
be resynchronised with other copies of that data file, it 
will establish a connection via the mobile communica- 
tions network 460, and will exchange the recorded mod- 
ification Jogs with other computer systems maintaining 
recorded modification logs. Steps 320, 330 and 340 of 
Figure 3 will then be performed by that controller 440 in 
order to update the local copy 420 of the shared data file. 
However, it will be apparent to those skilled in the 
art that the controller 440 and communication module 
450 could be located on a separate dedicated computer 
system. Each system maintaining a copy of the shared 
data file could then contain the other elements of the 
Mobile Applicatbn Framework in order to log changes 
made to that copy of the file. Periodically, the controller 
440 could connect to computer systems 400 over the 
mobile network to retrieve the logged changes made by 
those systems to their copies of the shared file. Steps 
320 and 330 could then be applied by the controller 440 
to merge the copies and resolve conflicts. Then the con- 
troller 440 could reconnect to the network in order to 
send the conflict -resolved sequence of modifications to 
each computer system 400. Step 340 would then be ap- 
plied by each computer system 400 in order to update 
the local copies of the shared file. 

In preferred embodiments, this latter approach is 
not used, since it involves connecting to the network 
twice in order to update a copy of a shared data file, and 
this increases the overhead of. the operation. Further, 
since the controller would be located on some central 
machine, details about the number of -changes being 
made to any particular copy of the shared data file will 
not be available, and so the controller would have to de- 
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cido when to update (he files based on some other cri- 
teria, eg time elapsed since last update. This may not 
be as efficient as basing update operations on the actual 
change activity to the copies of the shared data files, 
which can be done when using the system of the pre- 
ferred embodiment. However, the tatter approach does 
have the benefit that only one controller is involved, and 
so determination of when to exchange copies of the fifes 
is managed centrally. Hence, in some instances, it may 
be decided that the latter approach is worth employing. 

Whichever approach is used, it is apparent that giv- 
en prolonged periods of disconnected operation in the 
absence of any form of locking; conflicts are likely to 
arise between highly dynamic shared files. Hence, the 
^F.rameworkJrades consistency -for-availabilityrThe-di-" 
verge nee of files and the inconsistencies arising is not 
a problem unique to the Framework; to a lesser degree 
any distributed system suffers from these, and much 
work has been done both in the field of conflict detection 
and version-merging. However, all prior art techniques 
either resort to user interaction to resolve conflicts once 
they have been detected, or avoid conflicts in the first 
place. Most use locking or derivatives of it However, for 
the Framework, it is clear that any form of locking is out 
of the question due to the long periods of disconnected 
operation. 

Regarding the resolution of conflicts, it is clear that, 
when no semantic meaning can readily be associated 
with the files it is very difficult to resolve conflicts intelli- 
gently. While most approaches rely on the user to re- 
solve conflicts manually, it is believed that disconnected 
operation will only be acceptable to the user if conflicts 
can be resolved automatically. It should be clear that the 
automatic conflict resolution cannot be expected to pro- 
duce a logically coherent result in all imaginable cases. 
However, it is expected that the reconciliation will pro- 
duce a file that can be worked with. In the case of text- 
files, we hope to derive a file which can easily be 
'cleaned up' manually. In the case of data-files, the rec- 
onciliation process should preserve the file-format in 
such a way that the application program accessing the 
. file is still able to read it. 

Hence the Framework of the preferred embodiment 
requires a file logging and conflict detection method 
which does not impose any restrictions regarding the 
read- and write-access to files while in disconnected op- 
eration on the one hand, and logs enough information 
to allow a reasonable automatic conflict resolution on 
the other hand. 

According to preferred embodiments of the present 
invention, in the first instance, files within the Framework 
are considered as a sequence of characters. While 
carefully avoiding any assumptions regarding the con- 
tents-type, of the file, modifications are logged by* peri- 
odically comparing the current file with a backup-copy 
held by the bgger and computing a first approximation 
to the 'edit -distance'. The edit distance is a sequence of 
edit operations which converts a first string into a second 
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string, and thus essentially identifies how the user has 
modified the file. However, this is difficult and expensive 
to compute, and in preferred embodiments of the 
present invention, a first approximation to the edit dis- 
s tance is used, since it is simple and cheap to compute, 
and has been found to provide acceptable results. 

According to this approach, two atomic operations 
are defined, namely the 'insertion* and 'deletion' opera- 
tions. The logger aims to model any changes realised 
w to the logged file in terms of a sequence of these oper- 
ations. Preferably this is done by comparing the two 
strings (ie current and backup files) from either end, and 
determining the first and last character position where 
the two strings differ, ^rorn that. jan Jnference is made. 
-is * as to'wh^ther an iriseftfen, a deletion" or a "deieliorTfol- 
towed by an insertion, has been performed. 

Further, all modifications in the log are timed, thus 
providing the bases for automatic conflict resolution lat- 
er. Models may be available to customise the logging 
20 process and the edit-operations available for special 
file-formats. For example, the logging process can be 
modified by altering a file type definition within the model 
430, such that for instance it may contain information 
that instructs the logger 410 to split the file into pieces 
25 and to then consider each piece individually. 

For the automatic resolution of conflicts two ques- 
tions must be answered: 

Firstly, it is necessary to assign a priority to each 
modification so that, given two conflicting modifications, 
30 one will overwrite the other. This priority assignment is 
typically based on the location of the file copy; some file- 
systems which allow disconnected operation define a 
'master-copy' which, in the case of any conflicts, has pri- 
ority over all other copies. This approach is not taken in 
35 preferred embodiments since it is believed that users 
are likely to change between machines in which case it 
would not be sensible to bind the priority of a modifica- 
tion to the location at which it was executed. Instead, 
the preferred embodiment assigns priority-levels based 
40 on the identity of the user who modifies the file. The time- 
stamps recorded with the modifications are also used to 
assign priorities. The view that early modifications over- 
rule later ones is preferably adopted, since the opposite 
policy would lead to the counter-intuitive situation that 
45 modifications have a greater chance of committing suc- 
cessfully the later they are executed. 

Secondly, the handling of conflicting modifications 
has to be defined. Two policies have been found to be 
particularly useful in preferred embodiments of the 
50 present invention. With the 'Total Invalidation Policy', the 
conflicting lower-priority modification is completely in- 
validated. This may lose much information, but is guar- 
anteed to preserve the file format. Alternatively, a 'Par- 
tial Invalidation Policy* can be defined which only dis- 
55 cards the conflicting part of the lower-priority modifica- 
tion. Obviously, this has the advantage of only removing 
the minimum amount of information necessary to derive 
a non-conflicting set of modifications, but may not pre- 
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serve the file format. 

Within the framework, both the priority assignment 
rule and the invalidation policy can be defined, globally, 
by the user within the model 430. Figure 5 gives an over- 
view of this customisable component ('Model') within the 5 
reconciliation process. The logger 41 0 periodically conv 
pares the user's data file 420 with a back-up file 500 and 
determines the modifications executed by the user. For 
this purpose, it has available a file model* 510 describ- 
ing the outline of the file format, a set of 'edit operations' JO 
520 which may be executed by the user, and finally a 
set of conversion rules 530 to translate these edit oper- 
ations into a sequence of default INSERT and DELETE 
operations. The file model', 'edit operations' and 'con- 
-Yer.si°a_r.u les^can. be^j.sed Jo guide thejogger^jt 0 r for-.- 
special file types and formats; by default the logger 410 
' of the preferred embodiment relies solely on INSERT 
and DELETE operations and assumes a flat file format. 

The modifications detected in this fashion are 
stored in a log 540. At reconciliation time, logs 550 which 20 
are being received over the network from other copies 
of the same file are merged by the merger 560 in order 
of priority using a set of 'Priority Rules' 570. 'Invalidation 
Rules* 580 are then applied by the resolving/rerunning 
means 590 to detect and remove any conflicts in the 25 
merged set of modifications. Finally, the merged and 
reconciled log is executed on the local file copy 420. In 
a similar manner to the logging process, defaults are 
available for both the merging and the reconciliation. 
However, the user may decide to customise both proc- 30 
esses by supplying a set of alternative 'Priority Rules* 
and/or 'Invalidation Rules'. 

The set of all customisable parts forms the 'Model' 
430. Models may be defined for a set of files, for exam- 
pie all files of a specific file type, or for a particular file. 3$ 

A detailed description of an automatic conflict res- 
olution algorithm suitable for use in the Mobile Applica- 
tion Framework of the preferred embodiment is provided 
in the paper "File Replication in a Mobile Environment* 
by Stefan Hild and Peter Robinson, which is unpub- <o 
lished as at the priority date of the current application. 
A copy of this paper is enclosed for reference on the file 
of this application, and the contents of the paper are in- 
corporated by reference herein. The paper gives a de- 
tailed outline of a logging mechanism for computing a 
first approximation to the edit distance; and provides 
mathematical evidence that the merging and reconcili- 
ation steps described therein indeed produce a unique 
sequence of conflict-free modifications which can be ex- 
ecuted on each local copy of the shared file. Further- so 
. more, the paper gives evidence that the reconciliation 
process can also be applied in a sequence of partial rec- 
onciliations, ie in situations where not all file copies are 
synchronised at the same time, for exampte if individual 
nodes are out ol coverage area of the mobile commu- ss 
nications network or unavailable for any other reason. 

Within the paradigm of the Framework, data trans- 
missions are no longer initiated by applications but with- 



in the Framework itself, namefy by triggering a reconcil- 
iation process, as illustrated in the state-diagram of fig- 
ure 3. Hence, communication consists of the controlled 
exchange of modifications executed on files with known 
file-type. Prior to transmission the data contained within 
the logs can in preferred embodiments be optimised at 
various levels: 

Firstly, lossless compression methods can be ap- 
plied. This is straightforward and can be done with little 
or no penalty; most communication subsystems already 
apply some form of dictionary-based compression 
method at the packet-level. The compression achieved 
by these techniques is modest. 

Secondly, the type-information can be exploited and 
specQlised.compression-methods-xan be^applied; De~ : 
pending on the exact file-type, these lossy compression 
methods can be by magnitudes more efficient than loss- 
less methods, but are generally more expensive to ap- 
ply. 

Finally, data can be re-scaled to reflect the abilities 
of the remote node: For example, a high-resolution im- 
age file is reseated to reflect the pixel- and colour-reso- 
lution. Ail information necessary to re-generate the full 
resolution" image is left at the original site with a pointer 
to it from the remote node in case the full resolution im- 
age needs to be regenerated, for example if it is to be 
passed on the another high-resolution node. 

It is one ot the primary goals of the Mobile Applica- 
tion Framework that existing tools and programs can be 
used. However, by nature these cannot offer any sup- 
port for frame work-specific functions such as file recon- 
ciliation. We therefore envisage that applications can be 
written which are 'framework-aware' and have access 
to framework-internal information which may be used to 
assist the user in framework-specific functions. For ex- 
ample, modifications that have failed during the process 
of a reconciliation can be saved and, if required, re- 
stored. Modifications executed by other users can be . 
marked. Thus, they can make the reconciliation process 
more transparent and help to restore data that would 
otherwise be lost. 

As an example, a simple framework-aware ascii- 
text editor can be considered (see figure 6). It allows the 
user to 'see' which modifications have been carried out 
during the reconciliation process by marking the modi- 
fied areas using a colour-code 610 which directly corre- 
sponds to the source of the modification (deletions and 
failed modifications are indicated by inserting an artifi- 
cial marker into the text at the appropriate positions). By 
clicking on these markers the user can retrieve addition- 
al information 620 on this modification and can. if re- 
quired, reverse its effect. Figure 6 shows an example 
screen shot. With this, the user is given a simple tool to 
rescue data that may otherwise be lost during the rec- 
onciliation process. The resulting user interface is infor- 
mation-rich without being perceived as overloaded. 

From the above description, it is apparent that the 
Framework of the preferred embodiment comprises all 
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communication aspects in a single module within its 
structure (see figure 4). This not only provides a clear 
separation between the communication-oriented as- 
pects and functionalityK)riented modules of the frame- 
work itself but also between the communication on one s 
side and the applications running within the framework 
on the other. Communication is no longer initiated by the 
applications but by the framework. By concentrating all 
communication operations in one place it becomes pos- 
sible Jo tightly control all communication, a task that io 
would be impossible if a set of applications drove com- 
munication oh their own behalf independently. 

A second important distinction between conven- 
tional communication systems and the Mobile Applica- 
tion=Framework*isthe-reasoh v why communicatibrris'in-" 7 "'5 
itiated. In conventional systems, applications communi- 
cate to exchange information and data with other sites 
to ensure continuous operation; data is exchanged on 
an 'on demand'-basis. Within the framework, data is 
held locally so no communication is required to keep ap- 20 
plications operational. However, data kept locally is 
bound to grow out of date and the framework initiates 
communication solely to update the data files. This 
means that communication is not bound to a schedule 
dictated by the pace of running applications, as is the 25 
case if interactive applications, for example, rely on ex- 
ternal data to continue operation. Instead frequency and 
timing of reconciliation and synchronisation connections 
can be varied widely. The exact toning may be deter- 
mined by a number of factors: 30 

Log-driven updates . For each ffle, the amount of di- 
vergence tolerated at any one time may be specified in 
terms of logged modifications. If more modifications 
have been executed (i.e. the weighted aggregate length 
of all modifications exceeds some specified limit) a rec- 3$ 
onciliation process is triggered. So-called •pipeline-files' 
can be established which have an extremely low amount 
of tolerable divergence, which effectively means that 
each change to the file is immediately propagated to all , 
other sites. These files can be used as a convenient *o 
message-exchange facility between sites. 

Periodic updates . All sites may connect at periodic 
intervals. This makes sure small modifications are prop- 
agated eventually, even if the critical threshold to trigger 
a log-driven update is not exceeded. *s 

Current network costs and availability . Conditions 
to trigger reconciliations may be relaxed during off-peak 
hours while, network connections are available at a 
cheaper rate or while cheaper networks are available. 
For example, it is conceivable that the node may actually so 
be connected to a free wired network connection for cer- 
tain periods of time so reconciliations can be executed 
permanently. Then, the Framework effectively operates 
like a conventional 'Network File System'. Changes are 
propagated immediately to all copies and conflicts are ss 
consequently unlikely In the other extreme, reconcilia- 
tion steps may be delayed if mobile data channels are 
detected to be of poor quality, resulting in high error 



rates, many retransmissions and consequently high 
transmission costs. 

Update-on-Oemand . Some critical applications re- 
quire up-to-date data. Reconciliations can therefore be 
requested by applications and are served by the Frame- 
work normally immediately. Obviously, these applica- 
tions have to be written as Framework-aware applica- 
tions. 

It is envisaged that the user will be able to define a 
certain monetary budget which can be used up by the 
framework for reconciliations. This is possible by moni- 
toring typical modification patterns and by varying re- 
connections accordingly. 

TTie^y^de^np^ 
cation Framework of "the preferred efnocxjimenrihis b e- 
ing a generic system which allows standard applications 
to make use of mobile data links in a budgetable and 
controllable manner. This is achieved by adding support 
for disconnected operation on file system level. The 
problem of diverging files due to unrestricted access 
during long periods of disconnected. operation is solved 
by using loggers which create detailed modification his- 
tories for each replicated file, allowing fully automatic 
conflict resolution. Although a generic algorithm can 
never be expected to produce optimal results in all im- 
aginable cases, the resulting files could always be 
worked with and cleaned up manually if necessary. 

It is likely that sharing individual files between sev- 
eral users will occur far less frequently than replicating 
files on different machines for the same user. For exam- 
ple, the file-space of a large stationary desk-top ma- 
chine may be mirrored via the Framework on a small 
mobile note-book. In these cases, the user will be faced 
not only with the same working-environment on both 
machines, but also with the same applications. There- 
fore, the Framework is inherently easy to use. With the 
Framework the use of even a slow mobile data connec- 
tion can be made transparent to the user. 

The positioning of the Framework at the file-system 
level allows the communication sub-system tomake use 
of type information which can be inferred easily by ap- 
plying specialised compression and reduction methods 
to files prior to transmission. 

Furthermore, by containing all communication as- 
pects in one module and under the control of a single 
component, transmissions can be monitored easily and 
due to the benefits of disconnected operation the trans- 
mission frequency can be varied widely allowing the 
budgetability of transmission costs. 



Claims 

1 . A method.of managing copies of a shared data file 
maintained on a plurality of computer systems that 
are connectable via a mobile communications net- 
work (460). the method comprising: 
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a) for each copy (205, 420) of the shared dala 
file, maintaining a record (540) of modifications 
made to that copy; 

b) retrieving, via connection to the mobile com- 
munications network (460), the records (550) s 
maintained for other copies of the shared data 
file; 

c) merging (560) the retrieved records to gen- 
erate a sequence of modifications; 

d) applying predefined rules (580) to the se- 10 
quence of modifications to resolve conflicts 
within the sequence of modifications; and 

e) modifying the copies (205, 420) of the shared 
file based on the conflict-resolved sequence of 

. . . -modifications.- =r- -»-.«-r.*r.. --------- -' -75 

2. A method as claimed in Claim 1 , wherein said step 
(a) is performed on each of the plurality of computer 
systems, and the plurality of computer systems are 
disconnected from the mobile communications net- 20 
work during step (a). 

3. A method as claimed in Claim 1 or Claim 2, wherein 
the plurality of computer systems are only connect- 
ed to the mobile communications network (460) 25 
during said retrieval step (b). 

4. A method as claimed in any preceding claim, where- 
in each of said steps (a) to (d) are performed. on a 
number of said plurality of computer systems, said 00 
step (b) comprising the exchange, via connection 

to the mobile communications network (460), of the 
records (550) maintained by said number of the plu- 
rality of computer systems, and said step (e) com- 
prising the modification of the local copy (420) of 35 
the shared file. 

>. A method as claimed in any preceding claim, where- 
in priority information is stored with each modifica- 
tion as it is recorded during said step (a), and at said *o 
step (c) the priority information is used to assign rel- 
ative priorities to any conflicting modifications for 
subsequent resolution at said step (d). 

I. A method as claimed in claim 5, wherein the priority <s 
information stored at said step (a) comprises the 
identity of the user whomakes the modification. 

. A method as claimed in Claim 5 or Claim 6, wherein 
the priority information stored at said step (a) com- so 
prises time stamp information, such that an earlier 
modification has a higher priority than a later mod- 
ification. 

. A method as claimed in any of claims 5 to 7, wherein 55 
during.said step (d), a conflicting lower priority mod- 
ification is completely invalidated. 



9. A method as claimed in any of claims 5 to 7, wherein 
during said step (d), only the conflicting part of a 
lower priority modification is invalidated. 

10. A method as claimed in any preceding claim, where- 
in during said step (b), the records are compressed 
prior to being sent over the mobile communications 
network (460). 

11. A computer system for maintaining a copy (420) of 
a shared data file, copies of the shared dala file also 
being maintained on a plurality of other computer 
systems that are connectable to the computer sys- 
tem via a mobile communications network (460), 
"each computer sysTe"rfi"belhg arranged to keep a 
record (540, 550) of modifications made to its copy 
of the shared file whilst disconnected from the mo- 
bile communications network (460), the system 
comprising: 

retrieval means (440, 450) for connecting the 
computer system to the mobile communica- 
tions network (460) to retrieve the records (550) 
kept for copies of the shared data file main- 
tained on the plurality of other computer sys- 
tems; 

merging means (560) for merging the retrieved 
records (550) with the record (540) kept for the 
local copy (420) of the.shared data file to gen- 
erate a sequence of modifications; 
conflict resolving means (590) for applying pre- 
defined rules (580) to the sequence of modifi- 
cations to resolve conflicts within the sequence 
of modifications; and 

means (590) for modifying the local copy (420) 
of the shared file based on the conflict-resolved 
sequence of modifications. 

1 2. A data management system for managing copies of 
a shared data file' maintained on a plurality of com- 
puter systems that are connectable via a mobile 
communications network (460), the system com- 
prising: 

logging means (410), associated with each 
copy (420) of the shared data file, for keeping 
a record (540, 550) of modifications made to 
that copy; 

retrieval means (440, 450) for retrieving; via 
connection to the mobile communications net- 
work (460), the records maintained for other 
copies (420) of the shared data file; 
merging means (56.0) for merging the retrieved 
records to generate a sequence of modifica- 
tions; 

conflict resolving means (590) for applying pre- 
defined rules (580) to the sequence of modifi- 
cations to resolve conflicts within the sequence 
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of modifications; and 

means (590) for modifying the copies (420) of 
the shared file based on the conflict-resolved 
sequence of modifications. 

s 

13. A system as claimed in Claim 1 1 or Claim ^.where- 
in the plurality of computer systems are only con- 
nected to the mobile communications network 
whilst the retrieval means (440, 450) is retrieving 

the modification records. 10 

14. A system as claimed in any of claims 11 to 13. 
wherein priority information is stored with each 
modification as it is recorded, and the merging 
means:(560):is arranged to use the priority in forma- J "is " 
tion during the merging process to assign relative 
priorities to any conflicting modifications for subse- 
quent resolution by the conflict resolving means 
(590). 

20 

15. A system as claimed in claim 14, wherein the priority 
information stored with a modification comprises 
the identity of the user who makes that modification. 

16. A system as claimed in Claim 14 or Claim 15, 25 
wherein the priority information stored with a mod- 
ification comprises time stamp information, such 
that an earlier modification has a higher priority than 

a later modification. 



17. A system as claimed in any of claims 14 to 16, 
wherein the conflict resolving means (590) is ar- 
ranged to completely invalidate a conflicting lower 
priority modification. 

18. A system as claimed in any of claims 14 to 16, 
wherein the conflict resolving means (590) is ar- 
ranged to invalidate only the conflicting part of a 
lower priority modification. 

19. A system as claimed in any of claims 11 to 18, 
wherein the records are compressed prior to being 
sent over the mobile communications network (460) 
to the retrieval means (440, 450). 
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(54) Data management system and method for replicated data 



(57) The present invention provides a data manage- 
ment system and method for managing copies of a 
shared data file maintained on a plurality of computer 
systems that are connectable via a mobile communica- 
tions network. The system comprises: logging means 
410. associated with each copy 420 of the shared data 
file, for keeping a record 540 of modifications made to 
that copy; retrieval means for retrieving, via connection 
to the mobile communications network 460, the records 
550 maintained for other copies 420 of the shared data 
file; merging means 560 for merging the retrieved 
records to generate a sequence of modifications; con- 
flict resolving means 590 for applying predefined rules 



580 to the sequence of modifications to resolve conflicts 
within the sequence of modifications; and means 590 
for modifying the copies 420 of the shared file based on 
the conflict-resolved sequence of modifications. 

The present invention provides a generic platform 
which allows conventional applications to make efficient 
use of mobile data connections. The solution is generic 
in that it is not restricted to one application or to a par- 
ticular set ol applications. Further, it improves efficiency 
since it retains communication autonomy Irom the ap- 
plications and handles the data in an efficient manner 
Further ft is easy to use since applications need not be 
modified to make use of the facilities provided. 
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